Multi-Finger Gestures

ABSTRACT

Bezel gestures for touch displays are described. In at least some embodiments, the bezel of a device is used to extend functionality that is accessible through the use of so-called bezel gestures. In at least some embodiments, off-screen motion can be used, by virtue of the bezel, to create screen input through a bezel gesture. Bezel gestures can include single-finger bezel gestures, multiple-finger/same-hand bezel gestures, and/or multiple-finger, different-hand bezel gestures.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation application and, pursuant to 35U.S.C. § 120, is entitled to and claims the benefit of earlier filedapplication U.S. application Ser. No. 12/709,282 filed Feb. 19, 2010,the content of which is incorporated herein by reference in its entiretyfor all purposes.

BACKGROUND

One of the challenges that continues to face designers of devices havinguser-engageable displays, such as touch displays, pertains to providingenhanced functionality for users, without necessarily permanentlymanifesting the functionality as part of the “chrome” of a device's userinterface. This is so, not only with devices having larger or multiplescreens, but also in the context of devices having a smaller footprint,such as tablet PCs, hand-held devices, smaller multi-screen devices andthe like.

SUMMARY

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used as an aid in determining the scope of the claimed subjectmatter.

Bezel gestures for touch displays are described. In at least someembodiments, the bezel of a device is used to extend functionality thatis accessible through the use of so-called bezel gestures. In at leastsome embodiments, off-screen motion can be used, by virtue of the bezel,to create screen input through a bezel gesture. Bezel gestures caninclude single-finger bezel gestures, multiple-finger/same-hand bezelgestures, and/or multiple-finger, different-hand bezel gestures.

BRIEF DESCRIPTION OF THE DRAWINGS

The detailed description is described with reference to the accompanyingfigures. In the figures, the left-most digit(s) of a reference numberidentifies the figure in which the reference number first appears. Theuse of the same reference numbers in different instances in thedescription and the figures may indicate similar or identical items.

FIG. 1 is an illustration of an environment in an example implementationin accordance with one or more embodiments.

FIG. 2 is an illustration of a system in an example implementationshowing FIG. 1 in greater detail.

FIG. 3 illustrates an example computing device in accordance with one ormore embodiments.

FIG. 4 is a flow diagram that describes the steps in a method inaccordance with one or more embodiments.

FIG. 5 is a flow diagram that describes the steps in a method inaccordance with one or more embodiments.

FIG. 6 illustrates an example computing device in accordance with one ormore embodiments.

FIG. 7 illustrates an example computing device in accordance with one ormore embodiments.

FIG. 8 illustrates an example computing device in accordance with one ormore embodiments.

FIG. 9 illustrates an example computing device in accordance with one ormore embodiments.

FIG. 10 is a flow diagram that describes the steps in a method inaccordance with one or more embodiments.

FIG. 11 is a flow diagram that describes the steps in a method inaccordance with one or more embodiments.

FIG. 12 illustrates an example computing device in accordance with oneor more embodiments.

FIG. 13 illustrates an example computing device in accordance with oneor more embodiments.

FIG. 14 illustrates an example computing device in accordance with oneor more embodiments.

FIG. 15 is a flow diagram that describes the steps in a method inaccordance with one or more embodiments.

FIG. 16 is a flow diagram that describes the steps in a method inaccordance with one or more embodiments.

FIG. 17 illustrates an example computing device in accordance with oneor more embodiments.

FIG. 18 is a flow diagram that describes the steps in a method inaccordance with one or more embodiments.

FIG. 19 illustrates an example computing device in accordance with oneor more embodiments.

FIG. 20 is a flow diagram that describes the steps in a method inaccordance with one or more embodiments.

FIG. 21 illustrates an example computing device in accordance with oneor more embodiments.

FIG. 22 illustrates an example computing device in accordance with oneor more embodiments.

FIG. 23 illustrates an example computing device in accordance with oneor more embodiments.

FIG. 24 illustrates an example computing device in accordance with oneor more embodiments.

FIG. 25 is a flow diagram that describes the steps in a method inaccordance with one or more embodiments.

FIG. 26 is a flow diagram that describes the steps in a method inaccordance with one or more embodiments.

FIG. 27 illustrates an example computing device in accordance with oneor more embodiments.

FIG. 28 illustrates an example computing device in accordance with oneor more embodiments.

FIG. 29 illustrates an example computing device in accordance with oneor more embodiments.

FIG. 30 is a flow diagram that describes the steps in a method inaccordance with one or more embodiments.

FIG. 31 is a flow diagram that describes the steps in a method inaccordance with one or more embodiments.

FIG. 32 is a flow diagram that describes the steps in a method inaccordance with one or more embodiments.

FIG. 33 illustrates an example computing device that can be utilized toimplement various embodiments described herein.

DETAILED DESCRIPTION Overview

Bezel gestures for touch displays are described. In at least someembodiments, the bezel of a device is used to extend functionality thatis accessible through the use of so-called bezel gestures. In at leastsome embodiments, off-screen motion can be used, by virtue of the bezel,to create screen input through a bezel gesture. Bezel gestures caninclude single-finger bezel gestures, multiple-finger/same-hand bezelgestures, and/or multiple-finger, different-hand bezel gestures.

In the following discussion, a variety of different implementations aredescribed that involve bezel gestures, or gestures associated with bezelgestures, to initiate and/or implement functions on a computing device.In this way, a user may readily access enhanced functions of a computingdevice in an efficient and intuitive manner.

In the following discussion, an example environment is first describedthat is operable to employ the gesture techniques described herein.Example illustrations of the gestures and procedures are then described,which may be employed in the example environment, as well as in otherenvironments. Accordingly, the example environment is not limited toperforming the example gestures and the gestures are not limited toimplementation in the example environment.

Example Environment

FIG. 1 is an illustration of an environment 100 in an exampleimplementation that is operable to employ bezel gestures and othertechniques described herein. The illustrated environment 100 includes anexample of a computing device 102 that may be configured in a variety ofways. For example, the computing device 102 may be configured as atraditional computer (e.g., a desktop personal computer, laptopcomputer, and so on), a mobile station, an entertainment appliance, aset-top box communicatively coupled to a television, a wireless phone, anetbook, a game console, a handheld device, and so forth as furtherdescribed in relation to FIG. 2. Thus, the computing device 102 mayrange from full resource devices with substantial memory and processorresources (e.g., personal computers, game consoles) to a low-resourcedevice with limited memory and/or processing resources (e.g.,traditional set-top boxes, hand-held game consoles). The computingdevice 102 also includes software that causes the computing device 102to perform one or more operations as described below.

Computing device 102 includes a bezel 103 that forms part of thedevice's housing. The bezel is made up of the frame structure adjacentthe device's display, also referred to as display device 108 below.Computing device 102 includes a gesture module 104 and a bezel gesturemodule 105 that forms part of the gesture module 104. The gesturemodules can be implemented in connection with any suitable type ofhardware, software, firmware or combination thereof. In at least someembodiments, the gesture modules are implemented in software thatresides on some type of tangible, computer-readable medium examples ofwhich are provided below.

Gesture module 104 and bezel gesture module 105 are representative offunctionality that recognizes gestures and bezel gestures, respectively,and causes operations to be performed that correspond to the gestures.The gestures may be recognized by modules 104, 105 in a variety ofdifferent ways. For example, the gesture module 104 may be configured torecognize a touch input, such as a finger of a user's hand 106 a asproximal to display device 108 of the computing device 102 usingtouchscreen functionality. In addition, bezel gesture module 105 can beconfigured to recognize a touch input, such as a finger of a user's hand106 b, that initiates a gesture on or adjacent bezel 103 and proceedsonto display device 108. Any suitable technology can be utilized tosense an input on or adjacent bezel 103. For example, in at least someembodiments, the digitizer or sensing elements associated with displaydevice 108 can extend underneath bezel 103. In this instance,technologies such as capacitive field technologies, as well as others,can be utilized to sense the user's input on or adjacent to the bezel103.

Alternately or additionally, in embodiments in which display device 108does not extend underneath bezel 103, but rather lies flush with thebezel, bezel gesture module 105 can detect the changing contact profileof the user's finger as it emerges onto display device 108 from bezel103. Alternately or additionally, approaches that utilize the centroidof the user's touch profile can be utilized to detect a changingcentroid contact profile that is suggestive of a bezel gesture. Further,techniques for fingerprint sensing can be employed. Specifically, if thesensing substrate is sensitive enough to determine ridges of the fingeror fingers contacting the display, then the orientation of the finger(s)as well as the fact that the fingerprint is clipped by the bezel can bedetected. Needless to say, any number of different techniques can beutilized to sense a user's input relative to the bezel 103. The touchinput may also be recognized as including attributes (e.g., movement,selection point, etc.) that are usable to differentiate the touch inputfrom other touch inputs recognized by the gesture modules 104, 105. Thisdifferentiation may then serve as a basis to identify a gesture from thetouch inputs and consequently an operation that is to be performed basedon identification of the gesture. This yields the general benefit thatgestures that start from the bezel and enter onto the screen are, ingeneral, distinguishable from other ostensibly similar gestures thataccess on-screen content, since there is no reason for users to positiontheir fingers starting partially or fully off-screen if their intent isto interact with something on the screen. Hence, normal directmanipulative gestures, even for objects near the screen boundaries, arestill possible and do not interfere with bezel gestures and vice versa.

For example, a finger of the user's hand 106 a is illustrated asselecting 110 an image 112 displayed by the display device 108.Selection 110 of the image 112 and subsequent movement of the finger ofthe user's hand 106 a may be recognized by the gesture module 104. Thegesture module 104 may then identify this recognized movement asindicating a “drag and drop” operation to change a location of the image112 to a point in the display at which the finger of the user's hand 106a was lifted away from the display device 108. Thus, recognition of thetouch input that describes selection of the image, movement of theselection point to another location, and then lifting of the finger ofthe user's hand 106 a may be used to identify a gesture (e.g.,drag-and-drop gesture) that is to initiate the drag-and-drop operation.

A variety of different types of gestures may be recognized by thegesture modules 104, 105 such as gestures that are recognized from asingle type of input (e.g., touch gestures such as the previouslydescribed drag-and-drop gesture) as well as gestures involving multipletypes of inputs. For example, modules 104, 105 can be utilized torecognize single-finger gestures and bezel gestures,multiple-finger/same-hand gestures and bezel gestures, and/ormultiple-finger/different-hand gestures and bezel gestures.

For example, the computing device 102 may be configured to detect anddifferentiate between a touch input (e.g., provided by one or morefingers of the user's hand 106 a, 106 b) and a stylus input (e.g.,provided by a stylus 116). The differentiation may be performed in avariety of ways, such as by detecting an amount of the display device108 that is contacted by the finger of the user's hand 106 versus anamount of the display device 108 that is contacted by the stylus 116.

Thus, the gesture modules 104, 105 may support a variety of differentgesture techniques through recognition and leverage of a divisionbetween stylus and touch inputs, as well as different types of touchinputs.

Accordingly, the gesture modules 104, 105 may support a variety ofdifferent gestures. Examples of gestures described herein include asingle-finger gesture 118, a single-finger bezel gesture 120, amultiple-finger/same-hand gesture 122, a multiple-finger/same-hand bezelgesture 124, a multiple-finger/different hand gesture 126, and amultiple-finger/different-hand bezel gesture 128. Each of thesedifferent types of bezel gestures is described below.

FIG. 2 illustrates an example system showing the gesture module 104 andbezel gesture module 105 of FIG. 1 as being implemented in anenvironment where multiple devices are interconnected through a centralcomputing device. The central computing device may be local to themultiple devices or may be located remotely from the multiple devices.In one embodiment, the central computing device is a “cloud” serverfarm, which comprises one or more server computers that are connected tothe multiple devices through a network or the Internet or other means.

In one embodiment, this interconnection architecture enablesfunctionality to be delivered across multiple devices to provide acommon and seamless experience to the user of the multiple devices. Eachof the multiple devices may have different physical requirements andcapabilities, and the central computing device uses a platform to enablethe delivery of an experience to the device that is both tailored to thedevice and yet common to all devices. In one embodiment, a “class” oftarget device is created and experiences are tailored to the genericclass of devices. A class of device may be defined by physical featuresor usage or other common characteristics of the devices. For example, aspreviously described the computing device 102 may be configured in avariety of different ways, such as for mobile 202, computer 204, andtelevision 206 uses. Each of these configurations has a generallycorresponding screen size and thus the computing device 102 may beconfigured as one of these device classes in this example system 200.For instance, the computing device 102 may assume the mobile 202 classof device which includes mobile telephones, music players, game devices,and so on. The computing device 102 may also assume a computer 204 classof device that includes personal computers, laptop computers, netbooks,and so on. The television 206 configuration includes configurations ofdevice that involve display in a casual environment, e.g., televisions,set-top boxes, game consoles, and so on. Thus, the techniques describedherein are may be supported by these various configurations of thecomputing device 102 and are not limited to the specific examplesdescribed in the following sections.

Cloud 208 is illustrated as including a platform 210 for web services212. The platform 210 abstracts underlying functionality of hardware(e.g., servers) and software resources of the cloud 208 and thus may actas a “cloud operating system.” For example, the platform 210 mayabstract resources to connect the computing device 102 with othercomputing devices. The platform 210 may also serve to abstract scalingof resources to provide a corresponding level of scale to encountereddemand for the web services 212 that are implemented via the platform210. A variety of other examples are also contemplated, such as loadbalancing of servers in a server farm, protection against maliciousparties (e.g., spam, viruses, and other malware), and so on.

Thus, the cloud 208 is included as a part of the strategy that pertainsto software and hardware resources that are made available to thecomputing device 102 via the Internet or other networks. For example,the gesture modules 104, 105 may be implemented in part on the computingdevice 102 as well as via a platform 210 that supports web services 212.

For example, the gesture techniques supported by the gesture modules maybe detected using touchscreen functionality in the mobile configuration202, track pad functionality of the computer 204 configuration, detectedby a camera as part of support of a natural user interface (NUI) thatdoes not involve contact with a specific input device, and so on.Further, performance of the operations to detect and recognize theinputs to identify a particular gesture may be distributed throughoutthe system 200, such as by the computing device 102 and/or the webservices 212 supported by the platform 210 of the cloud 208.

Generally, any of the functions described herein can be implementedusing software, firmware, hardware (e.g., fixed logic circuitry), manualprocessing, or a combination of these implementations. The terms“module,” “functionality,” and “logic” as used herein generallyrepresent software, firmware, hardware, or a combination thereof. In thecase of a software implementation, the module, functionality, or logicrepresents program code that performs specified tasks when executed on aprocessor (e.g., CPU or CPUs). The program code can be stored in one ormore computer readable memory devices. The features of the gesturetechniques described below are platform-independent, meaning that thetechniques may be implemented on a variety of commercial computingplatforms having a variety of processors.

In the discussion that follows, various sections describe example bezelgestures and gestures associated with bezel gestures. A first sectionentitled “Use of Bezel as an Input Mechanism” describes embodiments inwhich a computing device's bezel can be used as an input mechanism.Following this, a section entitled “Using Off-Screen Motion to CreateOn-Screen Input” describes how a motion away from a device's screen canbe utilized, through gestures, to create on-screen input. Next, asection entitled “Use of Multiple Fingers for Gesturing” describes howmultiple fingers can be utilized to provide gestural input. Followingthis section, a section entitled “Radial Menus” describes embodiments inwhich radial menus can be utilized to provide a robust collection ofinput options. Next, a section entitled “On and Off Screen Gestures andCombinations—Page/Object Manipulation” describes various types ofgestures and combinations that can be utilized to manipulate pagesand/or objects. Last, a section entitled “Example Device” describesaspects of an example device that can be utilized to implement one ormore embodiments.

Use of Bezel as an Input Mechanism

In one or more embodiments, the bezel of a device can be utilized as aninput mechanism. For example, in instances in which the display deviceextends under the bezel, a user's finger or other input mechanism can besensed when it hovers over or physically engages the bezel. Alternatelyor additionally, the bezel can include sensing mechanisms, such asinfrared mechanisms as well as others, that sense a user's finger orother input mechanism hovering over or physically engaging the bezel.Any combination of inputs relative to the bezel can be used. Forexample, to provide various inputs to the device, the bezel can betapped one or more times, held, slid over, hovered over and/or anycombination of these or other inputs.

As an example, consider the following. Many selection, manipulation, andcontext menu activation schemes utilize a distinction between a device'sbackground canvas and objects that appear on the canvas. Using the bezelas an input mechanism can provide a way to access a page in thebackground canvas, even if the page itself is covered by manyclosely-spaced objects. For example, tapping on the bezel may provide amechanism to deselect all objects. Holding on the bezel could be used totrigger a context menu on the page. As an example, consider FIG. 3 whichillustrates an example environment 300 that includes a computing device302 having a bezel 303 and a display device 308. In this instance, afinger on user's hand 306 a is tapping on bezel 303. By tapping on thebezel, the user's input is sensed and an associated functionality thatis mapped to the input can be provided. In the above example, suchfunctionality might deselect all objects appearing on display device308. In addition, input can be received at different locations on thebezel and can be mapped to different functionality. For example, inputreceived on the right side of the bezel might be mapped to a firstfunctionality; input received on the left side of the bezel might bemapped to a second functionality and so on. Furthermore, input receivedin different regions of a bezel side might be mapped to differentfunctionality or to no functionality at all depending on the orientationof the device and how the user is holding it. Some bezel edges may beleft unassigned or may be insensitive to touch-and-hold, so thatinadvertent operations will not be triggered. Thus, any one particularside of the bezel might be utilized to receive input and, accordinglymap that input to different functionality depending on what region ofthe bezel receives the input. It is to be appreciated and understoodthat input received via the bezel can be received independent of anyinput received via hardware input devices, such as buttons, track balls,and other instrumentalities that might be located on an associateddevice. Further, in at least some embodiments, input received via thebezel can be the only user input that is utilized to ascertain andaccess a particular functionality. For example, input received solely onthe bezel can provide the basis by which device functionality can beaccessed. Further, in some embodiments, orientation sensors (e.g.accelerometers) may be used as an input to help decide which bezel edgesare active. In some embodiments quick, intentional tap remainsavailable, but only touch and hold is ignored to differentiate fromsimply holding the device with a finger that happens to be resting onthe bezel.

Alternately or additionally, in at least some embodiments, a visualaffordance can be utilized to provide a hint or indication of accessiblefunctionality associated with the bezel. Specifically, a visualaffordance can be utilized to indicate functionality that is accessibleby virtue of a bezel gesture. Any suitable type of visual affordance canbe utilized. As an example, consider again FIG. 3. There, a visualaffordance in the form of a semi-transparent strip 304 provides anindication that additional functionality can be accessed throughutilization of a bezel gesture. The visual affordance can take anysuitable form and can be located at any suitable location on displaydevice 308. Furthermore, the visual affordance can be exposed in anysuitable way. For example, in at least some embodiments, input receivedvia the bezel can be used to expose or display the visual affordance.Specifically, in at least some embodiments, a “peek out” visualaffordance can be presented responsive to detecting a hover over, or aphysical engagement of the device's bezel. The “peek out” visualaffordance can, in at least some embodiments, be deselected by the usersuch that the “peek out” is hidden.

In this particular example, the additional functionality associated withsemi-transparent strip 304 resides in the form of a so-called bezel menuwhich is accessible using a bezel gesture. Specifically, in one or moreembodiments, the bezel menu can be accessed through a gesture in which afinger of user's hand 306 b touches the bezel and then moves across thebezel and onto the display device 308 in the direction of theillustrated arrow. This can allow the bezel menu to be dropped down aswill be described in more detail below.

Accordingly, various embodiments can use the bezel itself as an inputmechanism, as in the first example above. Alternately or additionally,various other embodiments can use the bezel in connection with a visualaffordance that provides a clue to the user that additionalfunctionality can be accessed by virtue of a bezel gesture.

FIG. 4 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. The method can be implemented inconnection with any suitable hardware, software, firmware, orcombination thereof. In at least some embodiments, the method can beimplemented in connection with a system such as those systems that aredescribed above and below.

Step 400 receives an input associated with a bezel. Any suitable type ofinput can be received, examples of which are provided above. Step 402accesses functionality associated with the received input. Any suitabletype of functionality can be accessed. By virtue of providing a varietyof different types of recognizable inputs (e.g., taps, tap combinations,tap/hold combinations, slides, etc), and mapping those recognizableinputs to different types of functionalities, a robust collection ofuser input mechanisms can be provided.

FIG. 5 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. The method can be implemented inconnection with any suitable hardware, software, firmware, orcombination thereof. In at least some embodiments, the method can beimplemented in connection with a system such as those systems that aredescribed above and below.

Step 500 displays a visual affordance on a display device associatedwith a computing device. Any suitable type of visual affordance can beutilized, an example of which is provided above. Step 502 receives abezel gesture input relative to the visual affordance. Any suitable typeof bezel gesture input can be utilized. Step 504 accesses functionalityassociated with the received bezel gesture input. Any suitable type offunctionality can be accessed, an example of which is provided above anddescribed in more detail below.

Having considered examples in which the bezel can be used as an inputmechanism, consider now various embodiments that can utilize off-screenor off-display motion to create screen or display input.

Using Off-Screen Motion to Create On-Screen Input

In at least some embodiments, off-screen to on-screen motion (or viceversa) can be utilized as a mechanism to expose a menu or to access someother type of functionality. The off-screen motion or input can beprovided, as indicated above, relative to the device's bezel.

Any suitable type of bezel gesture input can be provided in order toeffectuate the off-screen to on-screen motion. For example, bezelgestures or inputs can, by way of example and not limitation, start orend on the bezel, cross or recross the bezel, cross at differentlocations of the bezel (e.g., the corners, or particular ranges ofcoordinates along a particular edge), and/or occur on one or more bezelsassociated with multiple screens (with the possibility of differentsemantics depending on the screen or edge thereof). Further, bezelinputs can include, by way of example and not limitation, asingle-contact drag (finger or pen), two-contact drag (two fingers),and/or a hand-contact drag (multiple fingers/whole hand/multiple orsingle fingers on different hands). For example, pinch gestures fromoff-screen space (i.e. originating on the bezel) can be utilized andmapped to different functionalities. For example, bezel gestures withmultiple contacts entering from different edges of the screen can havedifferent semantics. Specifically, two fingers entering from adjacentedges of the bezel (i.e. spanning a corner) might be mapped to a zoomout operation that zooms out on a page to show an extended workspace orcanvas. Two fingers entering from opposite edges, with either one hand(if the screen is small enough), or two hands (one finger from eachhand) can be mapped to a different functionality. Multiple fingersentering on one edge of the bezel and one finger entering from anadjacent or opposite edge of the bezel might be mapped to a differentfunctionality. Additionally, multiple fingers entering from two or moreedges can further be mapped to additional functionality.

As another example, consider FIG. 6. There, device 602 includes a bezel603 and a visual affordance 604 that is rendered on display device 608.As noted above, visual affordance 604, in the form of a semi-transparentstrip, can be utilized to provide a hint or indication of accessiblefunctionality, in this case a bezel menu, associated with the bezel.

In one or more embodiments, the bezel menu can be accessed through abezel gesture in which a finger of user's hand 606 touches the bezel andthen moves across the bezel and onto the display device 608 in thedirection of the illustrated arrow. This can allow bezel menu 610 to bedropped down at which time it can become fully opaque.

In the illustrated and described embodiment, bezel menu 610 includesmultiple selectable icons or slots 612, 614, 616, 618, and 620. Each ofthe icons or slots is associated with a different functionality such as,for example, paint functionality, pen functionality, note functionality,object creation, object editing, and the like. It is to be appreciatedand understood, that any type of functionality can be associated withthe icons or slots.

In the illustrated and described environment, bezel menu 610 can enablea user to access and activate commands, tools, and objects. The bezelmenu can be configured to respond to both touch input and pen input.Alternately or additionally, the bezel menu can be configured to respondonly to touch input.

In at least some embodiments, different gestural modes can be utilizedto access functionality associated with the bezel menu 610. For example,one gestural mode can be a novice mode, and another gestural mode can bean expert mode.

In the novice mode, after the user gestures to reveal the bezel menu610, the user can lift their finger, whereupon the bezel menu can remainopen for a configurable interval (or indefinitely). The user may thentap on a desired item associated with one of the icons or slots 612,614, 616, 618, and 620. Through this gesture, the functionalityassociated with a particular icon or slot can be accessed. For example,tapping on a particular icon or slot may cause an object to be createdon the canvas associated with display device 608. In at least someembodiments, in the novice mode, objects that are accessed from thebezel menu appear in default locations on the canvas. The user may closethe bezel menu by sliding it back off of the screen (anon-screen-to-offscreen gesture) or by tapping outside of the bezel menu,without activating any function.

In the expert mode, once the user is familiar with the location ofcommonly used items accessible from the bezel menu, the user can performa continuous finger-drag that crosses through the slot or icon and ontothe canvas to create and drag an associated object (or tool, orinterface mode) to a specific desired position or path, in a singletransaction. The user can then let go of the object and interact withit. As an example, consider FIG. 7. There, the user has performed abezel gesture that has dragged across icon or slot 614 to accessfunctionality associated with a post-it note and has positioned thecorresponding note on the canvas as indicated. At this point, the usercan lift a finger and annotate the digital post-it as desired using anassociated pen. In at least some embodiments, the bezel menu 610 may ormay not remain fully open after a particular functionality has beenaccessed.

In at least some other embodiments, in the expert mode, the bezel menumay not necessarily be revealed at all in order to access functionalityassociated with an icon or slot. Rather, a bezel gesture that crossesthe visual affordance at a location that corresponds to a particularicon or slot may access functionality associated with the icon or slot.As an example, consider FIG. 8. There, visual affordance 604 isillustrated. Notice that the bezel gesture crosses over a portion of thevisual affordance that corresponds to icon or slot 614 (FIG. 7). Noticealso that by virtue of this bezel gesture, a corresponding post-it notehas been accessed. This feature can be implemented by using a timedelay, e.g. ⅓ second, and considering the location of the user's fingerbefore actually deciding whether to deploy the bezel menu responsive toa bezel gesture. The idea here is that the bezel menu stays hiddenunless the user pauses, or just pulls out the menu, without completing adrag-off of the desired item. This is accomplished using a time delaybefore the bezel menu starts to slide out. Hence, once users arefamiliar with a particular operation on the bezel menu, they can rapidlydrag through it to create and position an object without ever having tobe distracted by the opening of the visual menu itself. This canencourage expert performance based on ballistic motion driven byprocedural memory, rather than visually guided performance based ondirect manipulation of a widget. The concept succeeds because the noviceway of using it helps to learn and encourage the expert way of workingwith it.

As but one example of how this can work in accordance with oneembodiment, consider the following. When the finger is observed to crossfrom the screen bezel into a slot of the bezel menu, a timer is started.No other immediate visual feedback occurs. When the timer expires, ifthe finger is still in the region occupied by the bezel menu, the bezelmenu slides out and tracks with the user's finger. When the user'sfinger lifts inside the bezel menu area, it stays posted. This is thenovice mode described above. The user can lift a finger to inspect allslots, and tap on the desired one to create the desired object (ratherthan dragging it). The user can also touch down and drag an item ontothe canvas from the novice mode. If the finger has slid past a thresholddistance or region, then the bezel menu remains closed but the functionindicated by the slot that was crossed is activated, e.g. a post-it iscreated and starts following the user's finger. This is the expert modedescribed above. An implementation consideration is that the slot thatis selected by the expert mode gesture can be determined by the locationat which the finger crosses the screen edge.

In at least some embodiments, the bezel menu can be scrollable in orderto provide access to the additional functionality. For example, thebezel menu can have left and right arrows on either side to enablescrollability. Alternately or additionally, a single or multi-fingerdrag that is orthogonal to the opening direction of the bezel menu canscroll it, without the need for any arrows.

In at least some embodiments, the bezel menu can create space foradditional slots or icons. For example, by reducing the width of slotsor icons that appear at the edge of the bezel menu, additional slots oricons can be added. As an example, consider FIG. 9.

There, a device includes a bezel 903 and a bezel menu 910 that appearson display device 908. Additional slots or icons 912, 914 appear in thebezel menu 910. Notice that the slots or icons 912, 914 have a reducedwidth relative to other slots or icons. In this example, the width isreduced by about one half. In order to access objects associated withslots or icons 912, 914, a bezel gesture can be used that drags over theslot or icon from the side of the device as shown. In some embodiments,the corner slots or icons can have a special status. For example, thecorner slots or icons may be permanently assigned to a particularfunctionality and may not be customizable.

Accordingly, bezel menus can be used to expose functionality to a userin a manner that does not permanently cause screen real estate to beoccupied or require the use of a dedicated hardware button.

FIG. 10 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. The method can be implemented inconnection with any suitable hardware, software, firmware, orcombination thereof. In at least some embodiments, the method can beimplemented in connection with a system such as those systems that aredescribed above and below.

Step 1000 displays a visual affordance associated with an accessiblebezel menu.

An example of a suitable visual affordance is given above. Step 1002receives a bezel gesture input relative to the visual affordance. Anysuitable bezel gesture can be utilized, an example of which is providedabove. Step 1004 presents, responsive to receiving the bezel gestureinput, a bezel menu. Any suitable bezel menu can be utilized. In atleast some embodiments, the bezel menu can be presented simply by virtueof receiving a bezel gesture without necessarily displaying a visualaffordance. Alternately or additionally, the visual affordance may fadein when the user's finger or pen hovers above an associated bezel edge.

FIG. 11 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. The method can be implemented inconnection with any suitable hardware, software, firmware, orcombination thereof. In at least some embodiments, the method can beimplemented in connection with a system such as those systems that aredescribed above and below.

Step 1100 receives a gesture input. The input can be received relativeto a bezel menu or a visual affordance associated with a bezel menu. Anysuitable gesture input can be received. For example, the gesture inputcan comprise an input that does not use or incorporate the bezel. Anexample of this was provided above in the discussion of FIG. 6 relativeto a user tapping on an exposed portion of the bezel menu. Alternatelyor additionally, the gesture input can comprise a bezel gesture input.An example of this was provided above in the discussion of FIGS. 7-9.Step 1102 ascertains a functionality associated with the gesture input.Step 1104 accesses the functionality that was ascertained in step 1102.Examples of how this can be done are provided above.

The examples above illustrate gestures, including bezel gestures thatutilize a single finger. In other embodiments, more than one finger canbe utilized in connection with gestures including bezel gestures.

Use of Multiple Fingers for Gesturing

In one or more embodiments, multiple fingers can be utilized forgesturing, including bezel gesturing. The multiple fingers can reside onone hand or, collectively, on both hands. The use of multiple fingerscan enable multiple numbers of touches to be mapped to differentfunctionalities or objects associated with functionalities. For example,a two-finger gesture or bezel gesture might be mapped to a firstfunctionality or a first object associated therewith, and a three-fingergesture or bezel gesture might be mapped to a second functionality or asecond object associated therewith. As an example, consider FIG. 12.

There, device 1202 includes a bezel 1203 and a visual affordance 1204that is rendered on the display device. As noted above, visualaffordance 1204, in the form of a semi-transparent strip, can beutilized to provide a hint or indication of accessible functionality, inthis case a bezel menu 1210, associated with the bezel.

As noted above, the bezel menu 1210 can be accessed through a bezelgesture in which a finger of the user's hand touches the bezel and thenmoves across the bezel and onto the display device to drag the bezelmenu down.

In one or more embodiments, bezel menu 1210 can be exposed and furtherextended into a drawer illustrated at 1212. In the illustrated anddescribed embodiment, the following bezel gesture can be used to exposedrawer 1212. First, a user touches down with one or more fingers on ornear the bezel 1203. This is illustrated in the top-most portion of FIG.12.

From there, the user can drag multiple fingers onto the display deviceas illustrated in the bottom-most portion of FIG. 12, thereby exposingdrawer 1212. In at least some embodiments, no objects are created, bydefault, when multiple fingers simultaneously cross the bezel menu. Thatis, in these embodiments, a multi-finger gesture as described aboveindicates that the drawer 1212 is being accessed. Drawer 1212 can haveadditional objects such as those that are illustrated. Additionalobjects can include, by way of example and not limitation, additionaltools, colors, and various other objects. In addition, in at least someembodiments, drawer 1212 can be utilized to store and/or arrange variousitems. Items can be arranged or rearranged in any suitable way such as,by direct manipulation by the user, e.g. by dragging and dropping anobject within the drawer.

In at least some embodiments, lifting the hand may leave the drawer openuntil it is later closed by way of a similar gesture in the oppositedirection. In at least some embodiments, bezel menu 1210 can becustomized using, for example, contents from drawer 1212. As an example,consider FIG. 13.

There, a user can change the default assignment of tools and/or objectsto the main bezel menu slots via a drag and drop operation. For example,in the top-most portion of FIG. 13, a user touches down on a new tool1300. The user then proceeds to drag tool 1300 into or onto one of theslots of bezel menu 1210. This gesture causes the object previouslyassociated with the slot to be replaced with the new object dropped bythe user.

Alternately or additionally, the user can also drag content from thepage or canvas into the drawer 1212. As an example, consider FIG. 14.There, the user has touched down on an object 1400 on the page or canvasand has dragged the object into drawer 1212. By lifting the finger, theobject 1400 is deposited into the drawer 1212.

It is to be appreciated and understood that while one drawer has beendescribed above, various other embodiments can utilize multiple drawers.For example, other edges of the display device can be associated withdifferent drawers. These different drawers may hold different tools,objects, or other content. On dual or multiple-screen devices, thedrawers for each screen edge may be identical or may be differentiated.In at least some embodiments, the multiple drawers may also be accessedon each screen edge by sliding orthogonal to the direction that thedrawer is opened. This can be done either by a single touch, and/ormultiple touches. If the bezel menu extends all the way to the screenedges, it can also be done by a bezel gesture from the orthogonal edge.

In the embodiment described just above, multiple touches were used toaccess drawer 1212. Specifically, as illustrated in FIG. 12, threetouches were used to access the illustrated drawer. In one or moreembodiments, different numbers of touches can be utilized to accessdifferent drawers. For example, two touches can be mapped to a firstdrawer, three touches can be mapped to a second drawer, four touches canbe mapped to a third drawer, and so on. Alternately or additionally, thespacing between multiple touches and variances therebetween can bemapped to different functionalities. For example, a two-finger touchwith a first spacing might be mapped to a first functionality; and, atwo-finger touch with a second, greater spacing might be mapped to asecond different functionality.

FIG. 15 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. The method can be implemented inconnection with any suitable hardware, software, firmware, orcombination thereof. In at least some embodiments, the method can beimplemented in connection with a system such as those systems that aredescribed above and below.

Step 1500 receives multiple-finger gesture input. Any suitable type ofgesture can be utilized including, by way of example and not limitation,bezel gesture input such as that described above. Step 1502 ascertains afunctionality associated with the multiple-finger gesture input.Examples of functionalities are described above. Step 1504 accesses theascertained functionality. Examples of how this can be done aredescribed above.

FIG. 16 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. The method can be implemented inconnection with any suitable hardware, software, firmware, orcombination thereof. In at least some embodiments, the method can beimplemented in connection with a system such as those systems that aredescribed above and below.

Step 1600 receives a bezel gesture input. Examples of bezel gestureinputs are described above. Step 1602 ascertains a functionalityassociated with the bezel gesture input. In this particular embodiment,the functionality associated with the bezel gesture input is one that isassociated with accessing one or more drawers. Step 1604 exposes one ormore drawers for the user. Examples of how this can be done aredescribed above.

Radial Menus

In at least some embodiments, so-called radial menus can be utilized inconnection with menus such as bezel menus. Although radial menus aredescribed, other types of menus can be used without departing from thespirit and scope of the claimed subject matter. For example, pull downmenus can be used in conjunction with bezel menus. One of the generalideas associated with radial menus is that a user can touch down at acertain location and stroke or slide their finger a certain direction toaccess and implement a particular functionality or menu command. Thepresence of a radial menu can be indicated by a small icon associatedwith a larger icon or slot of the bezel menu. As an example, considerFIG. 17.

There, device 1702 includes a bezel 1703 and a bezel menu 1710 that hasbeen exposed on display device 1708 as described above. In theillustrated and described embodiment, bezel menu 1710 includes multipleselectable icons or slots, one of which is designated at 1712. Each ofthe icons or slots is associated with a different functionality such as,for example, paint functionality, pen functionality, note functionality,object creation, object editing, and the like. It is to be appreciatedand understood, that any type of functionality can be associated withthe icons or slots.

As noted above, bezel menu 1710 can enable a user to access and activatecommands, tools, and objects. The bezel menu can be configured torespond to both touch input and pen input. Alternately or additionally,the bezel menu can be configured to respond only to touch input. In theillustrated and described embodiment, icon or slot 1712 includes aradial menu icon 1714 that gives a clue to the user that one or moreradial menus, for example radial menu 1715, is associated with thisparticular icon or slot. In the illustrated and described embodiment,the radial menu 1715 can be accessed in any suitable way, e.g. through apen or touch. For example, in at least some embodiments, the radial menu1715 can be accessed by hovering a pen over or near radial menu icon1714. Alternately or additionally, a pen or finger can be used to pulldown the radial menu 1715. Alternately or additionally, the radial menus1715 can be accessed through a tap-and-hold of the pen or finger on ornear the radial menu icon 1714. In some embodiments, tapping on theradial menu icon triggers a default action which may or may not bedifferent than the action associated with tapping on the bezel menuslot.

Once the radial menu 1715 is exposed, the user can access variousfunctionalities or commands by touching down on or near radial menu icon1714 and stroking in a particular direction. In the illustrated anddescribed embodiment, five different directions are indicated by thearrows. Each direction corresponds to a different functionality orcommand. Each functionality or command is represented, in the drawing,by a cross-hatched square. In at least some embodiments, each icon orslot 1712 has a default functionality or command. By selecting aparticular radial menu functionality or command, the defaultfunctionality or command may be replaced by the selected functionalityor command.

In at least some embodiments, the number of options presented by aradial menu can change depending on the location of the correspondingslot or icon with which the radial menu is associated. For example, inthe illustrated and described embodiment, slot or icon 1712 includesfive options for the user. Radial menus associated with slots or iconsthat appear at the ends of the bezel menu 1710 may have fewer optionsdue to spacing constraints. Alternately or additionally, radial menusassociated with slots or icons that appear as part of an exposed drawermay have more selectable options.

In at least some embodiments, radial menus can be implemented to includeboth a novice mode and an expert mode. In the novice mode, the radialmenu can be fully exposed to enable users who are unfamiliar with itsaccessible functionalities or commands to be visually guided through theselection process. In the expert mode, intended for users who arefamiliar with the content and behavior of radial menus, the radial menumight not be exposed at all. Rather, a quick touch-and-stroke gestureassociated with an icon or slot, such as icon 1712, may enable theradial menu's functionality or command to be accessed directly.

FIG. 18 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. The method can be implemented inconnection with any suitable hardware, software, firmware, orcombination thereof. In at least some embodiments, the method can beimplemented in connection with a system such as those systems that aredescribed above and below.

Step 1800 presents a bezel menu. Examples of bezel menus are providedabove. Step 1802 provides an indication of one or more radial menusassociated with the bezel menu. In the illustrated and describedembodiment, the indication resides in the form of a radial menu iconthat appears on a slot or icon of the bezel menu. Step 1804 receivesuser input associated with one of the radial menus. Examples of how thiscan be done are provided above. For example, in at least someembodiments, a radial menu can be visually presented to the user so thatthe user can then touch and stroke in a particular direction to providethe input. Alternately or additionally, a radial menu need notnecessarily be visually presented. Rather, a user who is familiar withthe radial menu's content and behavior can correspondingly gesture, asdescribed above, to provide the input. Step 1806 accesses, responsive tothe received user input, and the associated functionality or command.

In one or more embodiments, the bezel menu may or may not be rotatedwhen the screen orientation is rotated. For example, in some instancesit may be desirable to not rotate a bezel menu when the screenorientation is rotated. This may be particularly relevant inapplications where the content should not be rotated, e.g., a journalpage or a sketch pad where the user rotates the screen to afforddifferent drawing angles. In other instances, it may be desirable torotate the bezel menu when the screen orientation is rotated. Bydefault, it may be desirable to support the same number of bezel menuslots on all four edges of the screen so that menu items can be rotatedfrom the long edge or screen to the short edge of the screen withoutlosing some items.

Alternately or additionally, bezel menus can be customizable per screenorientation to enable different numbers of slots to be used on the longand short edges of the screen. In some instances, some edges of thescreen may be left without bezel items depending on the screenorientation. For example, the left and bottom edges, for a right-handedindividual, may be more likely to be swiped by accident, and may be leftwithout bezel menus if desired.

On and Off Screen Gestures and Combinations—Page/Object Manipulation

In one or more embodiments, on and off screen gesture combinations canbe utilized to manipulate pages and/or other objects. For example,combinations of on and off screen gestures can include gestures in whichinput is received on the screen relative to an object using one hand,and additional input in the form of a bezel gesture is received relativeto the object using the same or a different hand. Any suitable type ofgesture combinations can be used. As an example, consider FIG. 19.

There, a device 1902 includes a bezel 1903. A page 1904 is displayed onthe display device (not designated). In the illustrated and describedembodiment, a tear operation is performed using a combination of on andoff screen gestures. Specifically, in the bottommost portion of FIG. 19,a user's left hand or left index finger holds an object which, in thisexample, comprises page 1904. Using the right hand, the user initiates abezel gesture starting on bezel 1903 and moving in the direction of theindicated arrow through a portion of page 1904. By virtue of using asingle finger to indicate the tear operation, a partial tear of the pageis performed. A tear operation can be implemented by creating a bitmapof the portion of the page that has been torn away and rendering onlythat portion of the page that was not torn away. Alternately oradditionally, an object can be created to represent the torn-awayportion. In this created object, objects appearing in the torn-awayportion can be created to represent items appearing on the page.

In one or more other embodiments, a tear operation can be implementedusing multiple fingers. In these embodiments, the multiple finger inputcan be mapped to an operation that completely tears a page out of thecanvas or book in which the page appears.

In at least some embodiments, the direction of tearing can carry with itdifferent semantics. For example, a top-to-bottom tear may tear out anddelete a page. A bottom-to-top tear may tear out and allow dragging ofthe page to a new location.

FIG. 20 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. The method can be implemented inconnection with any suitable hardware, software, firmware, orcombination thereof. In at least some embodiments, the method can beimplemented in connection with a system such as those systems that aredescribed above and below.

Step 2000 receives on-screen input associated with an object. Anysuitable type of on-screen input can be received including, by way ofexample and not limitation, single-finger input and/or multiple-fingerinput. Step 2002 receives a bezel gesture input associated with theobject. Any suitable type of bezel gesture input can be receivedincluding, by way of example and not limitation, single-finger inputand/or multiple-finger input. Step 2004 ascertains functionalityassociated with both inputs. Step 2006 accesses the associatedfunctionality. Any suitable type of functionality can be associated withthe combination of on-screen and bezel gesture inputs, an example ofwhich is provided above.

Other page manipulations can be provided through the use of gestures,including bezel gestures. For example, page flipping and page saving(also termed “page pocketing”) can be provided as described below.

As an example, consider FIG. 21. There, a device 2102 includes a bezel2103 and a page 2104. As shown in the bottommost portion of FIG. 21, auser can flip to a previous page by using a bezel gesture that starts onbezel 2103 and proceeds rightward across the screen in the direction ofthe arrow. Doing so reveals the previous page 2106. Likewise, to turn tothe next page, a user would utilize a similar bezel gesture, but only inthe opposite direction. Using the page flipping gesture, the user'sfinger can lift at any suitable location on the screen.

In one or more embodiments, the semantics of page flipping gestures canvary from that described above. For example, in some instances a pageflipping gesture can be initiated as described above. However, if theuser pauses with their finger on the screen, multiple pages can beflipped through. Alternately or additionally, pausing the finger on thescreen in the middle of a page flipping gesture can cause additionalcontrols, such as section tabs, command palettes, or a bezel menu toappear.

Alternately or additionally, in at least some embodiments, the further auser's finger progresses across the screen, the more pages can beflipped. Alternately or additionally, multiple pages can be flipped byinitiating the page flipping gesture as described above, and then movingthe finger in a circular motion, either clockwise or counterclockwise.In this instance, clockwise motion would represent forward flipping, andcounterclockwise motion would represent backwards flipping. In thisimplementation, a circle may be fitted to the last N samples of motion.The speed of motion can be a function of the diameter of the circle.Note that in this implementation, the user does not have to circlearound any particular location on the screen, or even to draw a wellformed circle at all. Rather, any curvilinear motion can get mapped topage flipping in an intuitive manner, while also allowing the user toeasily stop and reverse course to flip in the opposite direction.

In at least some embodiments, a similar gesture can be used to save or“pocket” a page. In these embodiments, rather than the gestureterminating on the screen, as in the page flipping example, the gesturecan terminate on a bezel portion or other structure that lies across thescreen from where the gesture originated. As an example, consider FIGS.22 and 23.

There, a device 2202 includes a bezel 2203 and a page 2204. As shown inthe bottommost portion of FIG. 22, a user can save or pocket a page byusing a bezel gesture that starts on bezel 2203 and proceeds rightwardacross the screen in the direction of the arrow to a bezel portion thatlies opposite of where the gesture originated. Doing so reveals anotherpage 2206. In one or more embodiments, a distance threshold can bedefined such that, prior to the threshold, the page flipping experience,such as that described and shown in FIG. 21 can be provided. After thedefined distance threshold, a different page-saving or page-pocketingexperience can be provided. For example, in the FIG. 22 illustration,page 2204 has been reduced to a thumbnail. The page-saving orpage-pocketing experience can be provided by a combination of passingthe minimum distance threshold after a minimum timeout, such as ⅓second, when most page flipping gestures would have been completed. Inat least some embodiments, if the user lifts their finger prior toreaching the opposite-side bezel, a page flipping operation can bepresumed.

FIG. 23 illustrates a device 2302 that includes a bezel 2303 and twoseparate display screens 2304, 2306 separated by a spine 2308. Spine2308 can be considered as comprising part of the bezel or physicalstructure of the device. A page 2310 is illustrated as being displayedon display screen 2304.

As shown in the bottommost portion of FIG. 23, a user can save or pocketa page by using a bezel gesture that starts on bezel 2303 and proceedsrightward across the screen in the direction of the arrow to spine 2308that lies across the screen 2304 from where the gesture originated.Doing so reveals another page 2312. In one or more embodiments, adistance threshold can be defined such that, prior to the threshold, thepage flipping experience, such as that described and shown in FIG. 21can be provided. After the defined distance threshold, a differentpage-saving or page-pocketing experience can be provided. For example,in the FIG. 23 illustration, page 2310 has been reduced to a thumbnail.The page-saving or page-pocketing experience can be provided after aminimum timeout, such as ⅓ second, when most page flipping gestureswould have been completed. In at least some embodiments, if the userlifts their finger prior to reaching the spine 2308, a page flippingoperation can be presumed.

In one or more embodiments, portions of pages can be saved or pocketed.As an example, consider FIG. 24. There, a device 2402 includes a bezel2403 and two separate display screens 2404, 2406 separated by a spine2408. Spine 2408 can be considered as comprising part of the bezel orphysical structure of the device. A page 2410 is illustrated as beingdisplayed on display screen 2404.

As shown in the bottommost portion of FIG. 24, a user can save or pocketa portion of the page by using a bezel gesture. First, two fingers of auser's hand (in this case the left hand) sweep onto the screen from thebezel. In this particular instance, the user's left-hand initiates thebezel gesture from the spine 2408 and moves in the direction of thetop-most arrow. The region between the fingers—here illustrated at2412—is then highlighted. The user's other hand can then sweep acrossthe highlighted area to tear out the highlighted portion of the page andpocket or save the highlighted portion as shown. In one or moreembodiments, this gesture can be supported on any of the four edges ofthe screen, thus allowing horizontal or vertical strips to be torn fromeither screen by either right-handed or left-handed users. In at leastsome embodiments, the torn portion of the page can have two torn edgesand two clean-cut edges to distinguish it from pocketed pages or otherpocketed objects.

FIG. 25 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. The method can be implemented inconnection with any suitable hardware, software, firmware, orcombination thereof. In at least some embodiments, the method can beimplemented in connection with a system such as those systems that aredescribed above and below.

Step 2500 receives bezel gesture input relative to a page. Step 2502ascertains page manipulation functionality associated with the input.Any suitable type of page manipulation functionality can be ascertained,examples of which are provided above. Step 2504 accesses the ascertainedpage manipulation functionality.

FIG. 26 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. The method can be implemented inconnection with any suitable hardware, software, firmware, orcombination thereof. In at least some embodiments, the method can beimplemented in connection with a system such as those systems that aredescribed above and below.

Step 2600 receives on-screen input relative to a page. Any suitable typeof input can be received. In at least some embodiments, the receivedscreen input comprises a touch input or a stylus input. Step 2602receives a bezel gesture input relative to the page. Any suitable typeof bezel gesture input can be received, examples of which are providedabove. Step 2604 ascertains page manipulation functionality associatedwith the combined input. Examples of page manipulation functionality areprovided above. Step 2606 accesses the ascertained page manipulationfunctionality for purposes of implementing the functionality relative tothe page.

Thus, page flipping and page saving operations can be unified throughthe use of bezel gestures that included at least some common aspects.Unification of these two operations yields simplicity and facilitatesdiscoverability for users.

In one or more embodiments, other page manipulation operations can beimplemented through the use of bezel gestures. As an example, considerFIG. 27. There, a device 2702 includes a bezel 2703. A page 2704 isdisplayed on the display device (not designated). In the illustrated anddescribed embodiment, a bookmark tab can be created through the use of abezel gesture. Specifically, as shown in the bottommost portion of FIG.27, a bookmark tab 2706 can be created by initiating a gesture on thebezel 2703 and moving on to page 2704. In the illustrated and describedembodiment, the bezel gesture that creates the bookmark tab originateson a corner of the bezel as shown. Any suitable location on the bezelcan be utilized for creating a bookmark tab.

Alternately or additionally, bezel gestures can be utilized to dog-ear apage. As an example, consider FIG. 28. There, a device 2802 includes abezel 2803. A page 2804 is displayed on the display device (notdesignated). In the illustrated and described embodiment, a dog-ear canbe created through the use of a bezel gesture. Specifically, as shown inthe bottommost portion of FIG. 28, a dog-ear 2806 can be created byinitiating a gesture on the bezel 2803 and moving onto page 2804 andthen exiting the page in an opposite direction as illustrated by thearrows. In the illustrated and described embodiment, the bezel gesturethat creates the dog-ear originates on a corner of the bezel as shown.Any suitable location on the bezel can be utilized for creating adog-ear. For example, in other embodiments, a dog-ear can be createdthrough a bezel gesture that cuts across a corner of the page.

In one or more embodiments, gestures can be utilized to expose tabs suchas user-created or predefined tabs in a document. As an example,consider FIG. 29. There, a device 2902 includes a bezel 2903. A page2904 is displayed on the display device (not designated). In one or moreembodiments, tabs can be exposed by utilizing a bezel gesture that pullsat the edge of page 2904 as shown to expose a tab structure 2906. As thebezel gesture moves onto the screen, the page is pulled slightly to theright to expose tab structure 2906. In this instance, the gestureincludes two or more fingers that are held together as shown, ratherthan with a gap therebetween.

In one or more embodiments, continuing to drag the page can revealfurther structure. For example, continuing to drag the page can expose atable organizational view to the left of page 2904. In at least someembodiments, continuing the gesture across the entire page can save orpocket the entire page as described above.

FIG. 30 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. The method can be implemented inconnection with any suitable hardware, software, firmware, orcombination thereof. In at least some embodiments, the method can beimplemented in connection with a system such as those systems that aredescribed above and below.

Step 3000 receives a bezel gesture input relative to a page. Step 3002creates a bookmark tab relative to the page, responsive to receiving thebezel gesture input. Examples of how this can be done are providedabove.

FIG. 31 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. The method can be implemented inconnection with any suitable hardware, software, firmware, orcombination thereof. In at least some embodiments, the method can beimplemented in connection with a system such as those systems that aredescribed above and below.

Step 3100 receives a bezel gesture input relative to a page. Step 3102creates a dog-ear on the page, responsive to receiving the bezel gestureinput. Examples of how this can be done are provided above.

FIG. 32 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. The method can be implemented inconnection with any suitable hardware, software, firmware, orcombination thereof. In at least some embodiments, the method can beimplemented in connection with a system such as those systems that aredescribed above and below.

Step 3200 receives a bezel gesture input relative to a page. Step 3202exposes tab structure associated with the page. Examples of how this canbe done are provided above.

Example Device

FIG. 33 illustrates various components of an example device 3300 thatcan be implemented as any type of portable and/or computer device asdescribed with reference to

FIGS. 1 and 2 to implement embodiments of the gesture techniquesdescribed herein. Device 3300 includes communication devices 3302 thatenable wired and/or wireless communication of device data 3304 (e.g.,received data, data that is being received, data scheduled forbroadcast, data packets of the data, etc.). The device data 3304 orother device content can include configuration settings of the device,media content stored on the device, and/or information associated with auser of the device. Media content stored on device 3300 can include anytype of audio, video, and/or image data. Device 3300 includes one ormore data inputs 3306 via which any type of data, media content, and/orinputs can be received, such as user-selectable inputs, messages, music,television media content, recorded video content, and any other type ofaudio, video, and/or image data received from any content and/or datasource.

Device 3300 also includes communication interfaces 3308 that can beimplemented as any one or more of a serial and/or parallel interface, awireless interface, any type of network interface, a modem, and as anyother type of communication interface. The communication interfaces 3308provide a connection and/or communication links between device 3300 anda communication network by which other electronic, computing, andcommunication devices communicate data with device 3300.

Device 3300 includes one or more processors 3310 (e.g., any ofmicroprocessors, controllers, and the like) which process variouscomputer-executable or readable instructions to control the operation ofdevice 3300 and to implement the gesture embodiments described above.Alternatively or in addition, device 3300 can be implemented with anyone or combination of hardware, firmware, or fixed logic circuitry thatis implemented in connection with processing and control circuits whichare generally identified at 3312. Although not shown, device 3300 caninclude a system bus or data transfer system that couples the variouscomponents within the device. A system bus can include any one orcombination of different bus structures, such as a memory bus or memorycontroller, a peripheral bus, a universal serial bus, and/or a processoror local bus that utilizes any of a variety of bus architectures.

Device 3300 also includes computer-readable media 3314, such as one ormore memory components, examples of which include random access memory(RAM), non-volatile memory (e.g., any one or more of a read-only memory(ROM), flash memory, EPROM, EEPROM, etc.), and a disk storage device. Adisk storage device may be implemented as any type of magnetic oroptical storage device, such as a hard disk drive, a recordable and/orrewriteable compact disc (CD), any type of a digital versatile disc(DVD), and the like. Device 3300 can also include a mass storage mediadevice 3316.

Computer-readable media 3314 provides data storage mechanisms to storethe device data 3304, as well as various device applications 3318 andany other types of information and/or data related to operationalaspects of device 3300. For example, an operating system 3320 can bemaintained as a computer application with the computer-readable media3314 and executed on processors 3310. The device applications 3318 caninclude a device manager (e.g., a control application, softwareapplication, signal processing and control module, code that is nativeto a particular device, a hardware abstraction layer for a particulardevice, etc.). The device applications 3318 also include any systemcomponents or modules to implement embodiments of the gesture techniquesdescribed herein. In this example, the device applications 3318 includean interface application 3322 and a gesture-capture driver 3324 that areshown as software modules and/or computer applications. Thegesture-capture driver 3324 is representative of software that is usedto provide an interface with a device configured to capture a gesture,such as a touchscreen, track pad, camera, and so on. Alternatively or inaddition, the interface application 3322 and the gesture-capture driver3324 can be implemented as hardware, software, firmware, or anycombination thereof.

Device 3300 also includes an audio and/or video input-output system 3326that provides audio data to an audio system 3328 and/or provides videodata to a display system 3330. The audio system 3328 and/or the displaysystem 3330 can include any devices that process, display, and/orotherwise render audio, video, and image data. Video signals and audiosignals can be communicated from device 3300 to an audio device and/orto a display device via an RF (radio frequency) link, S-video link,composite video link, component video link, DVI (digital videointerface), analog audio connection, or other similar communicationlink. In an embodiment, the audio system 3328 and/or the display system3330 are implemented as external components to device 3300.Alternatively, the audio system 3328 and/or the display system 3330 areimplemented as integrated components of example device 3300.

Conclusion

Bezel gestures for touch displays have been described. In at least someembodiments, the bezel of a device is used to extend functionality thatis accessible through the use of bezel gestures. In at least someembodiments, off-screen motion can be used, by virtue of the bezel, tocreate screen input through a bezel gesture. Bezel gestures can includesingle-finger bezel gestures, multiple-finger/same-hand bezel gestures,and/or multiple-finger, different-hand bezel gestures.

Although the embodiments have been described in language specific tostructural features and/or methodological acts, it is to be understoodthat the embodiments defined in the appended claims are not necessarilylimited to the specific features or acts described. Rather, the specificfeatures and acts are disclosed as example forms of implementing theclaimed embodiments.

1-20. (canceled)
 21. A method comprising: detecting a gesture made on adevice having a bezel area adjacent a display area, the gestureindicative of a sliding motion of an input mechanism, the sliding motionhaving an origination in the bezel area, having a traversal that crossesa boundary between the bezel area and the display area, and having atermination in the display area; displaying a menu in the display areacomprising a plurality of menu slots in response to detecting thegesture; detecting that a path of the sliding motion of the gesturecrosses a first menu slot among the plurality of menu slots; andaccessing functionality associated with the first menu slot in responseto detecting that the path of the sliding motion of the gesture crossesthe first menu slot.
 22. The method of claim 21, further comprisingdisplaying a visual affordance in the display area in response to onsetof the gesture and prior to displaying the menu, the visual affordanceindicative of functionality that is accessible via the menu.
 23. Themethod of claim 22, further comprising displaying the visual affordancein response to the input mechanism coming into proximity of or makingcontact with the bezel area at the origination of the sliding motion ofthe gesture.
 24. The method of claim 21, further comprising, in furtherresponse to the gesture, displaying an object associated with thefunctionality at a location in the display area coincident with thetermination of the sliding motion of the gesture.
 25. The method ofclaim 24, further comprising, in further response to the gesture,displaying the object at a time when the path of the sliding motion ofthe gesture crosses a boundary between the first menu slot and thedisplay area and displaying the object being dragged to the location inthe display area coincident with the termination of the sliding motionof the gesture.
 26. The method of claim 21, further comprising enablingscrolling of the menu to provide access to additional functionality. 27.The method of claim 26, further comprising displaying left and rightarrow indicia to indicate scrollability of the menu.
 28. The method ofclaim 21, further comprising detecting an additional gesture made on thedevice, the additional gesture indicative of a sliding motion of theinput mechanism having an origination in the bezel area, having atraversal that crosses from the bezel area into the display area crossesa second menu slot among the plurality of menu slots.
 29. The method ofclaim 21, wherein the input mechanism is positioned in proximity to orin contact with a surface of the device that includes the bezel area andthe display area.
 30. The method of claim 21, wherein the inputmechanism is a single finger of a user.
 31. A non-transitorycomputer-readable storage medium having stored thereon computerexecutable instructions, which when executed by a computer device, causethe computer device to: detect a gesture made on the computer device,the computer device having a bezel area adjacent a display area, thegesture indicative of a sliding motion of an input mechanism, thesliding motion having an origination in the bezel area, having atraversal that crosses a boundary between the bezel area and the displayarea, and having a termination in the display area; display a menu inthe display area comprising a plurality of menu slots in response todetecting the gesture; detect that a path of the sliding motion of thegesture crosses a first menu slot among the plurality of menu slots; andaccess functionality associated with the first menu slot in response todetecting that the path of the sliding motion of the gesture crosses thefirst menu slot.
 32. The non-transitory computer-readable storage mediumof claim 31, wherein the computer executable instructions, which whenexecuted by the computer device, further cause the computer device todisplay a visual affordance in the display area in response to onset ofthe gesture and prior to displaying the menu, the visual affordanceindicative of functionality that is accessible via the menu.
 33. Thenon-transitory computer-readable storage medium of claim 31, wherein thecomputer executable instructions, which when executed by the computerdevice, further cause the computer device, in further response to thegesture, to display an object associated with the functionality at alocation in the display area coincident with the termination of thesliding motion of the gesture.
 34. The non-transitory computer-readablestorage medium of claim 33, wherein the computer executableinstructions, which when executed by the computer device, further causethe computer device, in further response to the gesture, to display theobject at a time when the path of the sliding motion of the gesturecrosses a boundary between the first menu slot and the display area anddisplaying the object being dragged to the location in the display areacoincident with the termination of the sliding motion of the gesture.35. The non-transitory computer-readable storage medium of claim 31,wherein the computer executable instructions, which when executed by thecomputer device, further cause the computer device to enable scrollingof the menu to provide access to additional functionality.
 36. Anapparatus comprising: one or more computer processors; and acomputer-readable storage medium comprising instructions for controllingthe one or more computer processors to be operable to: detect a gesturemade on the apparatus, the apparatus having a bezel area adjacent adisplay area, the gesture indicative of a sliding motion of an inputmechanism, the sliding motion having an origination in the bezel area,having a traversal that crosses a boundary between the bezel area andthe display area, and having a termination in the display area; displaya menu in the display area comprising a plurality of menu slots inresponse to detecting the gesture; detect that a path of the slidingmotion of the gesture crosses a first menu slot among the plurality ofmenu slots; and access functionality associated with the first menu slotin response to detecting that the path of the sliding motion of thegesture crosses the first menu slot.
 37. The apparatus of claim 36,wherein the computer-readable storage medium further comprisesinstructions for controlling the one or more computer processors to beoperable to display a visual affordance in the display area in responseto onset of the gesture and prior to displaying the menu, the visualaffordance indicative of functionality that is accessible via the menu38. The apparatus of claim 36, wherein the computer-readable storagemedium further comprises instructions for controlling the one or morecomputer processors to be operable, in further response to the gesture,to display an object associated with the functionality at a location inthe display area coincident with the termination of the sliding motionof the gesture.
 39. The apparatus of claim 38, wherein thecomputer-readable storage medium further comprises instructions forcontrolling the one or more computer processors to be operable, infurther response to the gesture, to display the object at a time whenthe path of the sliding motion of the gesture crosses a boundary betweenthe first menu slot and the display area and displaying the object beingdragged to the location in the display area coincident with thetermination of the sliding motion of the gesture.
 40. The apparatus ofclaim 36, wherein the computer-readable storage medium further comprisesinstructions for controlling the one or more computer processors to beoperable to enable scrolling of the menu to provide access to additionalfunctionality.